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GOVERNMENT LICENSE RIGHTS 
[0001] The U.S. Government has a paid-up license in the invention and the right in limited 
circumstances to require the patent owner to license others on reasonable terms as provided for by 
the terms of a contract awarded by the Department of the Army, Army Research Office. 

FIELD OF THE INVENTION 

[0002] The present invention generally relates to control systems for dynamic processes and, 
particularly, relates to adaptive control systems for minimizing errors in output control signals of 
uncertain nonlinear processes. 

BACKGROUND OF THE INVENTION 

[0003] Many control or pattern recognition computer systems are created by designing a 
function to model a selected set of data or statistics. From the modeled set of data, the computer 
system may control, estimate, correct or identify output data based on the modeled function. Many 
methods exist for creating functions that model data. Recently, neural networks have been 
employed to identify or create functional models for various types of systems. 
[0004] A neural network consists of simple interconnected processing elements. The basic 
operation of each processing element is the transformation of its input signals to a useful output 
signal. Each interconnection transmits signals from one element to another element, with a relative 
effect on the output signal that depends on the weight for the particular interconnection. A neural 
network may be trained by providing known input values and output values to the network, which 
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causes the interconnection weights to be changed until the desired system is modeled to a specified 
degree of accuracy or as precisely as reasonably possible. 

[0005] With statistics software or neural network software, input-output relationships 
during a training phase are identified or learned, and the learned input-output relationships 
are applied during a performance phase. For example, during the training phase a neural 
network adjusts connection weights until known target output values are produced from 
known input values. During the performance phase, the neural network uses connection 
weights identified during the training phase to impute unknown output values from known 
input values. The neural network accuracy depends on data predictability and network 
structure that is chosen by the system designer, for example, the number of layers and the 
number of processing elements in each layer. 

[0006] Because the reliability of a function modeled by a neural network depends on the 
reliability of data that is used to model a system, large quantities of data are often required to 
produce a model that satisfies the desired specifications. However, it can be difficult to 
collect data that represents all possible outcomes of a given system and, thus, a model of the 
system is created based on a training subset of data from the system from which predictions 
or corrections can be made. Because system functions based on the model may originate 
from data that was not contained in the initial training set, the potential for error within the 
system is increased with respect to the non-modeled input data. 

[0007] It is desirable to have a system that can adapt and learn to make predictions or 
corrections based on non modeled input data after the model has been put into action. This 
adaptive learning may be termed on-line learning. Due to the time that it takes to train a 
neural network, the use of neural networks have been limited to providing models for 
predictive systems when the inputs and outputs are known, such as a neural network used in 
predicting or recognizing a pattern based on selected inputs for which the system was 
trained. This type of system is not sufficient for producing accurate results in a control 
system environment where the model has not been trained for all possible outcomes or where 
nonlinearities or sudden changes may be introduced to the system under control. This is 
particularly true for the control of processes described by nonlinear differential equations of 
motion. It is well known by practitioners in the art that certain systems are difficult to 
control, such as systems in which the defining equations of motion for the process to be 
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controlled are poorly known with respect to their functional forms, or in which the functional 
forms themselves may undergo sudden and unexpected variation, particularly when the effect 
of the control action enters nonlinearly. Thus, in nonlinear systems, neural networks trained 
off-line will not produce results that minimize the error of the control system based on data 
received on-line. 

[0008] Because of the limitations in existing methods for training neural networks, and the 
general lack of a proof of stability in control applications in which the control enters 
nonlinearly, a technique which provides rapid on-line learning, and that insures stability for 
real time applications is highly desirable. Such a technique would have applicability in the 
field of flight control of either manned or unmanned aerial vehicles. For such applications, the 
dynamics are highly nonlinear and can undergo variations due to transitions in flight 
conditions, initiation of highly dynamic maneuvers involving large state excursions from trim 
flight conditions, or due to failures in actuators or due to damage to the airframe. 
[0009] A number of airframes for modern aircraft, particularly high speed military fighter 
aircraft, are inherently unstable, and require sophisticated control electronics to translate pilot 
control inputs into appropriate signals to actuate control devices. Problems in the design of 
such control systems arise from the fact that very complex nonlinear relationships describe the 
physical behavior of the aircraft. The relations vary in a complex way with aircraft speed, 
altitude, and angle of attack. The control system is, in many respects, only as good as the 
model of the nonlinear physical system upon which the controller is based. Therefore, any 
system that can adaptively learn to correct for defects in the modeling process can provide 
improved stability in aircraft control systems. 

[0010] Such a system is usable not only in the control of high speed military aircraft, but 
also for the control of other aircraft, such as helicopters. In particular, the system of the 
present invention is contemplated as useful in both control of high speed unstable aircraft and 
useful in the control of remotely controlled unmanned helicopter vehicles. 
[0011] Thus, there is a need in the art for an adaptive control system that insures both the 
capability for real-time, on-line learning and stability of the controlled process and that has an 
architecture that enables adaptation to processes in which the effect of the control action on the 
dynamics of the system is nonlinear. 
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SUMMARY OF THE INVENTION 



[0012] Generally described, the present invention provides a process and neural network 
architecture for on-line adjustment of the weights of the neural network in a manner that 
corrects errors made by a nonlinear controller designed based on a model for the dynamics of 
a process under control. 

[0013] More particularly described, the present invention provides a computer system for 
controlling the dynamic output response signal of a nonlinear physical process, where the 
physical process is represented by a fixed model of the process. The computer system 
includes a controlled device for responding to the output response signal of the system. The 
computer system also includes a linear controller for providing a control signal that is based 
on the fixed model for the process and provides a second controller, connected to the linear 
controller, for receiving the control signal and for providing a modified control signal to 
correct for the errors made in modeling the nonlinearities in the process. A response network 
can also be included as part of the computer system. The response network receives the 
modified control signal and provides the output response signal to the controlled device. 
[0014] The second controller preferably is a neural network. The computer system may 
include a plurality of neural networks with each neural network designated to control a 
selected variable or degree of freedom within the system. 

[0015] The present invention may be implemented as an improvement to flight control 
systems. The flight control computer system is designed for a set of flight dynamics of a 
particular aircraft. The flight control system implements a command augmentation system. 
The command augmentation system comprises an attitude control for providing a control 
signal used in determining a selected control signal for controlling an action of the aircraft; 
and an output control unit, connected to receive input from the attitude control, for 
generating the selected control signal based on the pseudo control signal. The present 
invention also provides a neural network connected between the attitude control and the 
output control for modifying the pseudo control signal based on data received during the 
flight of the aircraft to correct for errors made in modeling the nonlinearities in the flight 
dynamics of the aircraft. 
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BRIEF DESCRIPTION OF THE DRAWING(S) 

[0016] Fig. 1 shows an aircraft with a flight control system embodying the present 
invention; 

[0017] Fig. 2 is a block diagram of a flight control system embodying the present 
invention; 

[0018] Fig. 3 is block diagram illustrating an adaptive control used in conjunction with a 
second control; 

[0019] Figs. 4A and 4B are block diagrams showing further details of a control 
component illustrated in Fig. 3; 

[0020] Fig. 5 is a block diagram of a neural network implemented as a component of the 
adaptive control; 

[0021] Fig. 6 is a flow diagram of the steps of the processes implemented according to 
the present invention; 

[0022] Fig. 7 is a prior art flight control system that does not provide adaptive control; 
[0023] Figs. 8A and 8B show sample data of a simulation of control errors using the 
flight control system of Fig. 6; and 

[0024] Figs. 9A and 9B show sample data of a simulation of control errors using the 
flight control system of Fig. 2. 

DETAILED DESCRIPTION OF THE INVENTION 

[0025] It is an object of the present invention to use neural networks for learning and 
controlling on-line control processes. 

[0026] It is another object of the present invention to provide an on-line adaptive control 
to correct errors made by a controller. 

[0027] It is another object of the present invention to provide an adaptive controller that 
quickly adapts and corrects system processes although a crude model for the dynamics of a 
system were initially given. 

[0028] It is another object of the present invention to provide an improved adaptive 
controller that is particularly useful in a control system for an inherently unstable airframe. 
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[0029) It is still a further object of the present invention to provide an adaptive controller 
particularly useful in a flight controller for remotely controlled aircraft, including unmanned 
helicopter vehicles. 

[0030] These and other objects, features, and advantages of the present invention will 
become apparent from reading the following description in conjunction with the 
accompanying drawings. 

[0031] Referring to Fig. 1, a flight control computer system embodying the present 
invention is shown implemented in an aircraft 11. The present invention is directed to a 
system and method for a control system that may be utilized to minimize errors that may 
arise in a modeled control system due to nonlinearities in the modeled system. The flight 
control computer system 10 is one such control system that operates with nonlinear input 
variables. It should be appreciated that the flight control computer system 10 is located 
within the aircraft 11 and is shown in exploded view for the purpose of illustration. Basic 
hardware components of the flight control computer system 10 are illustrated. For simplicity 
of the drawings, many components of a standard computer system have not been illustrated 
such as address buffers, memory buffers and other standard control circuits because these 
elements are well known and illustrated in the prior art and are not necessary for the 
understanding of the present invention. A computer program used to implement the various 
steps of the present invention is generally located in the memory unit 12, and the processes of 
the present invention are carried out through the use of a central processing unit (CPU) 13. 
Those skilled in the art will appreciate that the memory unit 12 is representative of both read- 
only memory and random access memory. The CPU 13, in combination with computer 
software, controls the operations of the flight control computer system 10. The system bus 14 
supports communications of control, address, and data signals between the CPU 13 and the 
remaining components of the computer system 10. The memory unit 12 and the CPU 13 are 
connected by a computer system bus 14 designed to provide an electrical interface between 
computer system components. The processes implemented by the CPU 13 may be 
communicated as electrical signals along the computer system bus 14 to an input/output 
device 15 that serves to control the movement surfaces of the aircraft indicated by 8a, 8h, and 
8r. Actuators (ACT) 21 are utilized to aid in the facilitating the movement surfaces. Inputs 
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to the flight control system 10 may include pilot inputs 16 and integrated sensed inputs from 
an inertial measurement unit (IMU) 17 as known by those skilled in the art. 
[0032] In this detailed description, numerous details are provided such as sample data, 
and specific equations, etc., in order to provide an understanding of the invention. However, 
those skilled in the art will understand that the present invention may be practiced without 
the specific details. Well-known circuits, programming methodologies, and structures are 
utilized in the present invention but are not described in detail in order not to obscure the 
present invention. 

[0033] For purposes of this discussion, a process or method is generally a sequence of 
computer-executed steps leading to a desired result. These steps require physical 
manipulations of physical quantities. Usually, though not necessarily, these quantities take 
the form of electrical, magnetic, or optical signals that are capable of being stored, transferred, 
combined, compared, or otherwise manipulated. It is conventional for those skilled in the art 
to refer to these signals as bits, data, values, elements, symbols, characters, terms, numbers, or 
the like. Certain portions of the description which follow is presented in terms of equations. It 
should be appreciated that the operands of the equations are steps of a process that serve to 
manipulate the terms or characters of the equation to produce electrical signals for generation 
of input/output signals to control the various instruments and devices used in conjunction with 
the present invention. Standard notation is used in these equations as readily understood by 
those skilled in the art. It should be kept in mind, however, that these and similar terms should 
be associated with appropriate physical quantities inside the computer and that these are 
merely convenient labels applied to these physical quantities that exist within the computer. 
[0034] It should also be understood that manipulations within the computer system are 
often referred to in terms such as adding, subtracting, multiplying, dividing, comparing, 
moving, etc., which are sometimes associated with mental operations performed by a human 
operator. It should be understood that involvement of a human operator is not necessary in the 
present invention because the operations described herein are machine operations performed in 
conjunction with a human operator or user that interacts with the computer system. The 
machines used for performing the operation of the present invention include digital computers, 
circuit boards, digital chips or other similar computing devices known to those skilled in the 
art. 
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[0035] Although the aircraft 1 1 is shown as a fixed wing airplane, those skilled in the art 
will appreciate that the flight control computer system 10 embodying the present invention 
may be implemented with a helicopter or with unmanned aircraft. The flight control computer 
system 10 is used to aid a pilot in controlling the aircraft during flight. The flight control 
computer system 10 is particularly helpful in stabilizing the air frame of the aircraft. Without a 
stabilization system or a highly accurate stabilization system, the pilot's task of controlling the 
plane would be more difficult. 

[0036] Controlling the stabilization of an aircraft requires analyzing multiple variables or 
degrees of freedom to determine the appropriate control value needed to produce the desired 
stabilization. The multiple degrees of freedom or variables used in controlling or stabilizing an 
aircraft affect each other in a nonlinear manner and thus must be operated on accordingly. 
Generally, modeling errors enter a modeled system when there is a sudden alteration of the 
process or a failure occurs to a system device, such as failure of an actuator. Creating a 
nonlinear model to represent the various effects that multiple variables have on each other 
within a specified system can be difficult when accuracy and response speed are important, 
as with high performance aircraft. Generally, it is difficult to collect data that represents all 
possible outcomes of a given system. Thus, a model of the system is created based on a 
training subset of data from the system from which predictions or corrections can be made. 
Because system functions based on the model may originate from data that was not 
contained in the initial training subset, tiles potential for error within the system is increased 
with respect to the non-modeled input data. Thus, it is desirable to have a system that can 
adapt and learn to make predictions or corrections based on non-modeled input data. This 
adaptive learning may be termed on-line learning or control. 

[0037] Traditionally, neural networks are used to create an initial model based on a 
training subset of data. A model based on an initial training set may be termed an off-line 
model. Due to the time that it takes to train a neural network, the use of neural networks 
have been limited to providing models for predictive systems when the inputs and outputs are 
known, such as a neural network used in predicting or recognizing a pattern based on 
selected inputs for which the system was trained. This type of system is not sufficient for 
producing accurate results in a control system environment where the model has not been 
trained for all possible outcomes. Thus, in nonlinear systems such as aircraft control 
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systems, typical neural networks trained off-line will not produce results that minimize tile 
error of the control system based on data received on-line. The present invention provides 
such an adaptive control system that permits on-line adjustments of control parameters to 
accommodate or correct for data not utilized in an initial training set. 

[0038] Continuing the discussion of an aircraft flight control system embodying the 
present invention, aircraft flight control computer systems must account for multiple 
nonlinear variables or degrees of freedom. The degrees of freedom relevant to aircraft 
stabilization consist of three position variables and three attitude variables. Because the 
three position variables change slowly with respect to the attitude variables, a control system 
for an aircraft stabilization system can be treated as having only three degrees of freedom 
(i.e., the attitude variables). Attitude generally refers to the position or orientation of an 
aircraft, either in motion or at rest, as determined by the relationship between the aircraft's 
axis and some reference line or plane or some fixed system of reference axes. The attitude 
variables are given in terms of angles. The attitude angles are generally represented by roll-\fs 
pitch-0, and yaw-4> in the determination of appropriate control signals in flight control 
computer systems. The angular rates (J), 0, and \J/ are Euler angular coordinates. However, 
two types of angular rates are encountered in flight control computer systems. The other types 
of angles are body angular rates in which roll is represented by p c , pitch is represented by q c 
and yaw is represented by r c . The body angular rates are measured rates and are generally 
transformed to Euler angular rates in a flight control system. 

[0039] Referring to Fig. 2, the general operation of a flight control computer system 10, 
which may be generally termed a command augmentation system (CAS), that implements the 
present invention will be discussed. The characteristics of flight control systems utilizing a 
CAS are chosen using aircraft handling specifications that are preferred by human pilots. As 
noted above, there are many degrees of freedom that have an effect on airplane stability or 
control. Of these degrees of freedom or controls, the CAS of Fig. 2 is designed to receive a 
roll rate pc command and a normal acceleration command a nc , from the pilot, while the CAS 
automatically accounts for other commands and degrees of freedom to provide airframe 
stability. Additionally, a command augmentation unit 19 regulates or maintains a zero angle of 
side slip S during airplane maneuvers. 
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[0040] The CAS output 20 provides a roll rate pc, which is the pilot's roll rate command as 
passed through the command augmentation unit 19, a pitch rate q c , which is calculated based on 
the normal acceleration command a nc and the side slip S, and a yaw rate r c , which is also based 
upon the normal acceleration a nc and the side slip S. As noted above, these angular rates roll p c , 
pitch q c , and yaw r c are body angular rates. In the system shown, the roll p c is input by a pilot 
and the pitch q c and yaw r c commands are computed quantities. These body angular rates are 
then passed on to the attitude orientation system 18 to be received at a command transformation 
system 22. The command transformation system 22 transforms the body angular rates to Euler 
coordinates which are given as the first derivatives of <|> c t Q c t and ^ c (i.e., the first derivatives 
of roll, pitch, and yaw, respectively in Euler coordinates). The command transformation output 

24 is then passed along to an integrator 26 which outputs the appropriate roll , pitch 0 , and 
yaw ^ coordinates. These coordinates are passed on to an attitude controller 30. In this 
nonlinear control system, the attitude controller represents the linear portion of an adaptive 
controller 25. 

[0041] The adaptive controller 25 includes the attitude controller 30 and a neural network 
controller 34. The attitude controller 30 in connection with the neural network controller 34 
produces pseudo control vectors after ue, and u\j/ 9 as discussed in more detail below. The 
adaptive controller 25 serves to adjust the pseudo control vector on-line. The adaptive controller 

25 receives feed back data as indicated by path 29. 

[0042] A controller or inverse function 32, used in the CAS, consists of a neural network, as 
discussed in more detail below, that models the initial function for determining the appropriate 
control signal to provide to the plane's stabilizing system based on off-line training. As noted 
herein, off-line generally means that the weights defining the neural network used to define the 
inverse function 32 were determined according to a set of known inputs and known outputs prior 
to on-line implementation of the flight control system shown in Fig. 2. It should be appreciated 
that the function for the inverse function 32 can be derived using systems other than neural 
networks as known by those skilled in the art. 

[0043] In prior art methods (shown in Fig. 7), the u vector calculated or produced from an 
attitude controller would be passed on to the neural network controller 32 in order to produce a 
command based on off-line training data. However, the neural network 34 and its position 
within the architecture of the system shown in Fig. 2 provide the present invention with the 
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capability of adjusting the u vector based upon actual learned or adjusted values from on-line 
input data. The neural network 34 thus allows for on-line adjustment of its connection weights 
which permits the neural network 34 to correct for errors made by the inverting function 32 for 
which the attitude controller 30 does not account. The inverse function 32 then outputs the 
appropriate control variable aileron and/or differential tail, 5a, elevator, 5h, and rudder, 5r, for 
use in stabilizing the aircraft 11. The differential tail 5a primarily produces a rolling moment, 
elevator 5h primarily produces a pitching moment, and rudder 5r primarily produces a yawing 
moment. The roll moment corresponding to the differential tail movement is caused by turning 
or rotating two horizontal parts of the airplane's wing or tail in opposition to one another. The 
elevator or pitch movement of the plane is adjusted by moving the left and right tail surfaces 
synchronously in the same direction to cause a plane to either elevate or de-elevate. The yaw 
moment corresponding to rudder movement is caused by movement of the vertical surface on the 
tail to the left or right. These foregoing moments may also be accomplished by using synthetic 
jets, a technology known to those skilled in the art. By implementing the neural network 34 to 
learn nonlinear functions that were not accounted in an initial training set used for developing a 
model of the control system, the magnitude of error and the speed at which errors are reduced for 
control signals, such as 5a, 5h, or 5r, are improved over prior control systems. 
[0044] Referring to Fig. 3, a more detailed block diagram of the components of the adaptive 
control 25 for the system with multiple degrees of freedom is shown. The adaptive control 25 of 
the flight control computer system 10 forms part of control network 42a, control network 42b 
and control network 42c for the inverse model. Each network 42a, 42b, and 42c has the inverse 
function 32 for the respective degrees of freedom, cj> , 0, and \p. 

[0045] The adaptive control 25 consists of the attitude controllers 30a, 30b, and 30c and the 
neural networks 34a, 34b, and 34c for providing signals to the inverse function 32, respectively. 
The neural networks may be coupled by the connection line 35 as described in more detail in 
connection with Fig. 4B. The adaptive control 25 may employ each of the neural networks 34a, 
34b, and 34c to define the architecture for pseudo control signal u that is input the inverse 
function 32. The output of each of the neural networks 34a, 34b, and 34c modifies the linear 
output of the attitude controllers 30a, 30b, and 30c which corresponds to the neural networks 
34a, 34b, and 34c, respectively. Entering the attitude controller 30a is a measured roll value <|> 
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and a command roll value § c as well as the respective first derivatives of these values <j> and<j> c . 
The derivative <j> c and other command derivatives indicated herein are obtained by from the 
command transformation unit 22 of Fig. 2 as discussed above. The inputs to the attitude 
controller 30b are a measured pitch value 0 and a command pitch value 0 C , and the respective 

first derivatives of these values 0 and 0 C . The inputs to the attitude controller 30 c , are a 
measured yaw value V and a command ^ c and the respective first derivatives of these values 
^ and ^ c . The measured values are based on values actually measured by the IMU 17 (Fig. 1) 
on board the aircraft 1 1 . 

[0046] Referring to Fig. 4a, a more detailed view of the network 42a is shown. Fig. 4a 
shows a node 60 which is used to create the pseudo vector u^ , as modified by the utilization of 

the neural network 34a of the present invention. At the node 60, the output of a proportional- 
derivative linear controller 31c u^ , is added to the second derivative <|) c of the control signal <j) , 

the sum of which is then subtracted by the output of the neural network u n (() . From node 60, it 
can be seen that u<|) depends on u n <j> . That is, the current input of the networks 34a is a function 
of its current output. This process may be termed an iterative or recursive process, which gives 
rise to the need for a fixed point solution as discussed herein. The second derivative (|> c 

indicated herein is obtained by digitally filtering the signals <|> and <j> c through filter 33. The 

output u n <|) of the neural network 34a serves to correct for the nonlinearities that are learned 
during on-line processing of actual flight control data. The implementation of the neural 
network 34a thus enables the present invention to provide more accurate output controls 8 for a 
modeled system. The inputs to the neural network 34c, as well as to the inverse function 32 are 
Q,B 9 V 9 ty 9 §,§,\Xy 9 and u 0 . The generalized detail for calculating the appropriate values for 

each of the networks 42a, 42b, and 42c are shown and described in connection with Fig. 4B. 
[0047] Referring to Fig. 4B, x is used as a generalized symbol for each degree of freedom, in 
this example ^, <£, or 0. It should be appreciated that more degrees of freedom may be used 
with the present invention than those illustrated and discussed in connection with the figures 
above. The functions, processes and operations of the elements of Fig. 4B are given by the 
equations and discussion below. The discussion in connection with Figs. 4B and 5 may apply to 
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any system which uses an on-line adaptive controller for learning and processing data in real 
time. 

[0048] As noted above, a nonlinear control system may be designed, using techniques known 
by those skilled in art, where the process dynamics of the actual system can be characterized by 
the equation: 

Actual System x =f(x, x,8) (Eq. 1) 

where the vectors x and x make up the elements of the state 10 vector, and 5 is the control 
vector, all being of equal dimension (n). The vector* is generally a measured value such as <J>, 
0, and ^ discussed above. The dimension (n) is referred' to as the number of degrees of 
freedom, and a subscript i=l...n will be used to denote the / th degree of freedom, corresponding 
to the i lh element in the vector x. In the example discussed above, n=3 to represent the three 
degrees of freedom <E>, 0, and ^. A model of the actual system may be represented by the 
following equation: 

Model x = f (x, x,5) (Eq. 2 ) 

A well known method of controlling nonlinear systems of this form when the nonlinear function 
f(x,x,8) is known is based on state feedback inversion. State feedback inversion entails 
designing a so-called pseudo state feedback control, u(x, x) as a linear controller, such as 
controllers 31 in Figs. 4A and 4B and then inverting the nonlinear function / so that 5 can be 
computed once u is determined, such as the inverse function 32. Notationally, the inversion 
function can be expressed as 

8=f' 1 ( X§ . x,u) (Eq.3) 

where f'*(x, x ,8) is the inverse of the model f(x, x ,5) of the actual nonlinear function f[x, x ,5). 
When the function J(x, x ,8) is poorly modeled, or when the system being controlled undergoes a 
rapid or unexpected change, then the above procedure for using the inverse of a model is 
inadequate for practical applications. However, the present invention utilizes an adaptive 
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controller such as an adaptive controller 25 (Figs. 24B) that employs a neural network 34 in 
defining the architecture for the pseudo control u;(x, x). The pseudo control u,(x, x) used in 
controlling the i th degree of freedom may be represented by equation 4 in the following form: 

u,(x, xj= u,(x t x) + X ci (t)- u n (x, x,u) (Eq. 4) 

where ii,(x,x) is the output of a linear controller 31 designed for the linear system . is the 

command signal for the / th degree of freedom, and u n (x, x,u) is the output of a neural network 

34. The pseudo control u,(x f x) is calculated at node 60 in Fig. 4. The architecture and processes 

of u n (x,x,u) are defined by equation 5: 

u n (x, x ,u) = £w u (Oft,/ (x, x,u) (Eq. 5) 

j 

where wgj is the connection weight for the i ih degree of freedom and j represents the number of 

elements for each degree of freedom. It should be appreciated that the number of elements j may 

vary for each degree of freedom according to the designer's specifications. 

[0049] The u input of inputs 64 to the neural network 34 represents all u vectors except the 
w,; vector for which the control signal is being determined. 

[0050] Many approaches known in the art exist for defining the linear part of the controller 
31. For the purposes of the discussion herein, it will be assumed that the linear controller 31 has 
the so-called "proportional + derivative" form: 

ufi) = k pi [xi(t) - x ci (t)] + kdif x 1(0 - x ci (t) (Eq. 6) 

as processed at node 62. It should be appreciated that other processes or forms can be equally 
treated for a linear controller within the context of the present invention. For this choice of linear 
control, the connection weights Wjj(t) are adjusted on-line and in real time according to the 
following weight adjustment process: 

wg = jj [ ei / 2k pi + ft (1 + 1/kpi) / 2kdi] frj (x, x ,u) (Eq. 7) 

where ei(t) = xi(t) - xci(t) (i.e., the error value between the measured value xi(t) and command 
value xci(t)) and 7i is a constant learning rate. The weight adjustment processes are well known 
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to those skilled in the art. The learning weight 7i, as known by those skilled in the art, is chosen 
by the designer of the neural network. The learning weight determines how much a given input 
should effect the various connection weights of the system (i.e., the learning rate of the system). 
Because the weight adjustment process or equation is given in terms of the first derivative of the 
connection weight values wi,J(t), only a bank of analog or digital integrators, for these weight 
values wi„j(t), is needed for the on-line adjustment of the neural network weights as given by 
Eq. 7. 

[0051] The gain constants k pi (proportional constant) and fa (derivative constant) may be 
chosen by techniques known to those skilled in the art familiar with proportional/derivative 
control. There is considerable latitude in designing the particular manner in which the gains k p j 
and k di enter the weight adjustment process. In all cases, the basic form of the weight adjustment 
process remains similar that shown in Eq. 7. Having determined the pseudo control vector u, the 

real control b(t) is then computed using the approximate inverse function 8 = f ' 1 (x, x,u) 

[0052] One skilled in the art is provided a wide latitude in selecting the basis functions 

p iJ (x t x t u). In general, 0. .(x,i,ii) should be chosen so that the neural network 34 corrects for 

the differences between f(x,x,u) and the actual, but unknown inverse function ]' ! {x,x,u). In 
the absence of any additional information concerning these differences, polynomial functions of 
x, x and u may be employed. Such polynominal functions, as known to those skilled in the art, 
are described in Kim, B.S. and Calise, AJ., "Nonlinear Flight Control Using Neural Networks," 
AIAA Guidance, Navigation, and Control Conference, Paper # 94-3646, AZ, Aug. 1-3, 1994 
which is herein incorporated by reference. In any case, some provision should be made for the 
fact that whatever set of basis functions is selected, perfect correction can rarely be achieved, and 
under these circumstances a dead zone, as known by those skilled in the art, is employed to 
deactivate the weight adjustment process, as given in Eq. 7, when a positive scalar function of 
the tracking errors and e{t) is below a specified level. The dead zone feature is used in a 

stability proof to insure that the tracking errors remain bounded and ultimately reach and remain 
on the boundary of the dead zone. For a suitably comprehensive set of basis functions, the size 
of the dead zone can be reduced to near zero. The use of a dead zone in adaptive control is a 
well-known approach that is often employed as a part of a stability proof. The details regarding 
the stability proof and the design of a dead zone for this application may be found in Kim, B.S. 
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and Calise, A.J., "Nonlinear Flight Control Using Neural Networks," AIAA Guidance, 
Navigation, and Control Conference, Paper # 94-3646, AZ, Aug. 1-3, 1994. 
[0053] Two advantageous features are presented by the architecture and processes 
implemented by the neural network 34. First, the neural network basis functions (3 u (x t x,u) that 

shape the network outputs u"(t) are functions of the elements of u(x,x). Therefore, the system 
is enabled to operate with systems that are nonlinear in the control. Since u{t) depends on 
u n (t), it follows that the i th network input depends on the present outputs of all the networks. 
Therefore, a so-called fixed point solution is used to define the network 34 outputs. In order to 
determine the fixed point, a network is iterated until a fixed point solution is determined. A 
variety of well known approaches for calculating a fixed point solution, or to approximate its 
solution to within practical limits are known by those skilled in the art. The architecture for the 
neural networks 34 defined by this invention is illustrated in Fig. 5. 

[0054] Having discussed the steps of present invention in connection with the architecture of 
the system, the steps of present invention will be discussed generally in connection with the flow 
diagram of Fig. 6. The specific steps implemented in the preferred embodiment of the present 
invention are discussed in connection with Figs. 2, 4, 5, and 6. The steps preferably are 
implemented as a computer-implemented routine in the flight control system. This program may 
reside in memory of the flight control computer system 12. Referring to Fig. 6, the steps for 
producing a control signal based on receipt of on-line data for a nonlinear aircraft system is 
discussed. At step 600, the state and command vectors that are fed back along path 29 and 
forward along paths 23 and 24 are provided to the attitude controller 30. At step 602, a linear 
pseudo control signal u is calculated for the data received during the process. At step 604, the 
state vectors and pseudo controls are received at the on-line neural network 34. After receipt of 
the input data at the neural network 34, a fixed point solution is calculated for the input at step 
606a and the weight adjustment process occurs as indicated at step 606b. At step 606c, the 
neural network 34 modifies and corrects for inverse modeling errors as discussed above and 
provides a signal u" (t) that is used at the node 60 (Figs. 4A and 4B) to calculate a modified 
pseudo control signal u r The process then proceeds to step 610. At step 610, the inverse 
response function 32, which is based on a model for the process, receives u x and computes the 
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control signal 5. The control signal 5 is then transmitted to an output response device, such as 
synthetic jets or hydraulic actuator devices for controlling the moving surfaces of the aircraft 1 1 . 
Such devices respond to the control signal 5 to adjustment controlled devices, as indicated at step 
612. 

[0055] The following text discusses computer simulations implementing the present 
invention. High fidelity six degree of freedom computer simulations have been conducted to 
demonstrate the usefulness of the network processes and control architectures depicted in Figs 1 
- 6. The results indicate that these architectures can offer an improved approach to flight control 
design that can tolerate large uncertainties in aerodynamic modeling and sudden failures in 
actuator channels. 

Command Augmentation System (CAS) Design : 

[0056] Fig. 7 depicts the architecture of a CAS design based on a conventional feedback 
linearization design. The structure and implementation of the design of Fig. 7 is more fully 
discussed in Menon, P.K., "Nonlinear Command Augmentation System for a High-Performance 
Aircraft," AIAA Guidance, Navigation, and Conference, Paper # 93-3777, Monterey, CA, Aug. 
9-13, 1993 which is herein incorporated by reference. 

[0057] The structure of Fig. 7 uses an outer loop controller (command augmentation logic) to 
regulate the slower dynamics, consisting of translational dynamics. The outer loop generates 
body angular rate commands (p c , q c , and r c ) to the inner attitude control loop controller. The 
inner loop converts these commands to attitude rate commands, and uses an approximate inverse 
model to regulate the fast attitude dynamics. The pilot inputs to the CAS are chosen as roll rate 
command and normal acceleration command. The control variables are aileron and/or 
differential tail, elevator and rudder (8 a , 5/„ 5 r ), which are used to control the three degrees of 
freedom in attitude. The CAS is required to stabilize the airframe while following normal 
acceleration and roll rate commands from the pilot. In addition to these functions, the CAS has 
responsibility for maintaining zero angle of sideslip during maneuvers. 

[0058] Referring to Fig. 2, the role of neural networks in the architecture of Fig. 2 is divided 
into two functions: (1) an off-line designed network 32 that realizes the approximate inverse 
function for the inner loop, and (2) a second on-line network 34. The neural network 34 
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compensates for imperfect inversion and in-flight changes in the actual aircraft dynamics. The 
neural network 34 is trained on-line using the weight adjustment process of Equation 7. For this 
example, the neural network 32 was trained over a limited portion of the flight envelope, using 
aircraft aerodynamic and propulsive data. 

Off-line Network Performance : 

[0059] Fig. 8A illustrates statistical measures for the performance of the control process of 
Fig. 7 as implemented with an F18 aircraft. Fig. 7 A shows the effect that initial altitude and 
Mach number have on the root mean square error of the network output 32b for a high g turn 
maneuver. The error is computed by comparison to the controls 8 a 5/, 8 r computed by using an 
off-line method of inverting the exact dynamics. It can be seen in Fig. 8 A that for h 0 = 10,000 ft, 
the worst case root mean square error increases for both low and high initial Mach numbers. The 
increases for low and high initial Mach number occur because some portion of the flight is 
outside the off-line training envelope for the neural network 32b. For M 0 = 0.5 the starting Mach 
number lies below the training range, and for M 0 = 0.9 the Mach number exceeds the training 
range during the maneuver interval. A moving average of the rms error is illustrated in Fig. 8B 
that exhibits the effect as a function of time. Also consider the maneuver initiated at M 0 = 0.7 
and ho = 20,000 ft. The example maneuver exhibits a large rms error that is sustained over the 
last 20 seconds of flight. Over this portion of the trajectory the Mach number is nearly constant 
and near 1 .0. Although this lies within the training range, it corresponds to a region where the 
errors were larger than average due to the more complex variation that the aerodynamic data 
exhibits near Mach 1. That is, an off-line trained network 32 with weights trained to provide 
good average performance over a given envelope of data can exhibit large errors within a portion 
of the envelope that has a high degree of complexity in its mapping. 

On-line Network Performance : 

[0060] Figs. 9A and 9B illustrate the statistical measures for the performance of a system 
that implements the neural network structures 32 and 34 as discussed above. Note that the rms 
errors in Fig. 9A are an order of magnitude lower than those of Fig. 8A.Fig. 9B (moving average 
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results) shows that the errors are of extremely short duration in comparison to Fig. 8B. For 
example, when M 0 = 0.5, and ho = 10000 ft, the result initially starts outside the neural network 
32 training envelope, which is the cause for the high initial error. However, the initial error 
exhibited in Fig. 8B is rapidly reduced by the on-line weight adjustment process used in Fig. 2 as 
the results of Fig. 8B illustrate. Likewise when M 0 = 0.7, and ho = 20000 ft, the result shows that 
errors exhibited in a network of Fig. 8B in the transonic region are rapidly reduced by use of the 
neural network 34 of Fig. 2. The errors at approximately 8 seconds correspond to the initiation 
of the high g maneuver. These results show the potential for rapid adaptation using the on-line 
architectures discussed in connection with Figs. 1-5 in combination with the online process for 
weight adjustment given in Equation 7. 

[0061] The foregoing relates to the preferred embodiment of the present invention, and many 
changes may be made therein without departing from the scope of the invention as defined by the 
following claims. 
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